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Robotics  CTA  Overview 


Army  Needs 


Experience 


Network 

Centric 


Battle  Team  Focus 
Constrained  Bandwidth 
Info.  Dissemination 


Human  Performance 
Trust  in  Automation 
Workload  Theory 


Autonomous  Mobility 
Tactical  Behaviors 
Safe  Operations 


Hybrid  Architectures 
&  Reactive  Behaviors 


RDECOM 


Applied  Research 


l-n  UAVs 

C2  for  Manned  /  Unmanned, 
Air  /  Ground  Battle  Teams 


Using  the  best  resources  in  Government,  Industry  and 
Academia  to  develop  and  validate  robotic  technologies 
that  meet  current  and  future  Army  needs... 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


CTA  Inception 

•Terrain  Based  Preplanning 

•  Fixed  Behaviors  with  Fragile 
Performance 

•  Limited  Replanning  Under  Failure 
Conditions 

•  Extensive  Human  Interaction 
Required 


Required 

•Automatic  Planning  & 
Replanning  with  Limited 
Human  Interaction 

•  Dynamic  Replanning  Based 
on  Perception,  Tactical 
Information,  &  Frag  Orders 

•  Robust  Behaviors  to  Operate 
Over  a  Wide  Range  of 
Situations 


Human  Machine 
Interface 


Intelligent 

Control 


|  |  Technology  at  Program  Inception 

|  |  State  of  Current  Technology 

|  |  Technology  Level  Resulting  from 

CTA  Investment 


/ 

CTA  Inception 

•  Road  Following  on  Well 
Defined  Surfaces 

•  Slow  Cross-Country 
Navigation  in  Relatively 
Benign  Terrain 

•  Highly  Sensitive  to 
Environmental  Effects 

•Vulnerability  while 
Platform  is  in  Motion 


»  CTA  Task  Areas 


Required 

•  Decision  Aids  for  Offloading 
Operator 

•  Rapid  Context  Switching  Between 
Multiple  Platforms 

•  Robotic  Platform  Supervision  & 
Tasking 

•  Multi-Model  Input/Output 

•  Multi-Platform  &  Mixed  Asset 
Tasking 


CTA  Inception 

•  Human  Intensive  Planning 

•  Extensive  Teleoperation  Required 

•  Operator  Saturation 


CURRENT 

•  Program  making 
steady  progress 
toward  required 
capabilities 


^  Perception 

Required 

•All  Weather,  Day/Night 

•  Complex  Environments 

•  Recognition  of  Tactical  Situations 

•  Speed  Commensurate  with 
OPTEMPO 

•  Perception  for  Mid-Range  Planning 

•  Understanding  of  Moving  Agents 
while  Platform  is  in  Motion 

•  Perception  to  enable  Vehicle 
Safeguarding 


Requires  advancing  the 
state  of  the  art  in  three 
critical  areas: 

•  Perception 

•  Intelligent  Control 

•  Human  Machine  Interface 

Requires  integrating 
research  advances  from 
all  three  areas  using  a 
system-level  approach  to 
provide  a  mechanism  for: 

•  Field  experimentation  and 
research  validation 

•  User  input 
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i  ^  Robotics  CTA  Members  and  Objectives 


Consortium  Members 


■  General  Dynamics 
Robotic  Systems 
(Lead  Industrial  Partner) 

■  Carnegie  Mellon  University 

■  Applied  Systems 
Intelligence 

■  Jet  Propulsion  Laboratory 

■  Alion  Science  & 
Technology 

■  BAE  Systems 

■  Sarnoff  Corporation 

■  SRI  International 

■  Florida  A&M  University 

■  University  of  Maryland 

■  PercepTek 

■  Robotic  Research 

■  Signal  Systems  Corp 

■  Howard  University 

■  NC  A&T  University 

■  University  of  Pennsylvania 

■  Skeyes  Unlimited 


Make  the  research  investments  that 
support  the  Army’s  robotic  system 

development  goals:  Advanced  Perception 


•  Develop  perception  technologies 
that  allow  robotic  vehicles  to  sense 
and  understand  their  environment; 

•  Develop  intelligent  control 
technologies  and  architectures 
enabling  robotic  systems  to 
autonomously  plan,  execute,  and 
monitor  operational  tasks 
undertaken  in  complex,  tactical 
environments; 

•  Develop  human-machine  interfaces 
that  allow  soldiers  to  effectively  task 
robotic  systems  and  minimize 
operator  workload. 


■  Intelligent  Control  & 
Behavior  Development 


■  Human  /  Machine 
Interfaces 


T  Robotics  CTA  -  Member  Distribution 


RDECOM 
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H  ^  Advances  in  Sensors  and  Perception 


LADAR  Development  &  Processing  Algorithms 


Terrain  Classification 


Moving  Agent  Understanding 


Air  /  Ground  &  Mid-Range  Sensing 
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H  ^  Advances  in  Intelligent  Control 


Tactical  Behaviors 


Collaborative  Operations 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 

^ ■ 


H  ^  Advances  in  Human  Machine  Interface 


Scalable  Human  Machine  Interfaces 


Multi-Modal  Input 


Workload  /  Trust  in  Automation 


HMI  Interface  Extensions 
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) 


T  Evaluation  and  Experimentation  Overview  rdecom 


Stages  of  Experimentation  and  Integration 


Proof  of  Concept  Testing  with  COTS  Hardware 

Researchers  test  proof  of  concept  in  their  own  labs  with  commercial 
off-the-shelf  (COTS)  hardware.  The  image  at  right  is  from  the 
Carnegie  Mellon  Robotics  Institute  Laboratory. 


Perception  and  Autonomous  Navigation  Testing  with  GDRS 
Standardized  Test  Facilities 

GDRS  facilities  are  used  to  test  perception  and  autonomous 
navigation  tasks.  Data  is  analyzed  against  the  ground  truth  of  known 
obstacles.  ARL  and  NIST  design  quantitative  experiments. 


Simulation  Testing  with  RCTA  SIL 

The  RCTA  Systems  Integration  Lab  (SIL)  at  GDRS  provides  a 
hardware-in-the  loop  simulation  testbed  for  Advanced  Perception, 
Intelligent  Control  Architecture  (ICA)  and  Human  Machine  Interface 
(HMI)  technologies. 


Integration  and  Testing  in  Realistic  Environments 

New  technology  is  integrated  and  tested  on  the  Demo  III  XUV  and 
commercial  vehicles  in  various  terrains  including  rolling  and  forested 
terrain,  as  well  as  a  MOUT  environment  at  Fort  Indiantown  Gap. 
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Capability  Developed  in  FY  2007 

Leverages  Visualization  Technology  from 
COTS  Gaming  Technology 

Exploits  Graphics  Technology 

to  Emulate  Vehicle  Sensors 


Engineering  Tools 


Hardware-in-the-Loop 


Simulation  Engine 
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RCTA  FY07  Metrics 


Robotics  Collaborative  Technology  Alliance  Metrics  FY07 

Metric 

FY02-06 

FY07 

Scholarly  Papers 

182 

26 

Invention  Disclosures 

2 

2 

Patent  Applications  Filed 

5 

1 

Masters  Degrees  Awarded 

12 

9 

Ph.Ds.  Awarded 

10 

4 

Graduate  Students  Supported 

88 

14 
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0 


RCTA  Transitions  to 


Provided  the  technical  foundation  for  FCS- 
ANS  and  the  demonstration  in  2003  that 
was  instrumental  in  funding  FCS  unmanned 
ground  systems 

-  Field-tested  LADAR  hardware 

-  LADAR  processing  algorithms  for  obstacle 
detection,  classification  algorithms  for 
obstacle  detection,  and  terrain  classification 

-  Engineering  visualization  tools  for  LADAR 
and  vehicle  planner  development 

-  Field-tested  robotic  testbed  platforms  (with 
interfaces  to  navigation  sensors),  capable  of 
data  collection  and  archiving  in  realistic 
tactical  environments 

-  LADAR  optics,  TX/RX  electronics  and 
processing  firmware  (FFT,  multi-pulse, 
ranging,  etc.) 

-  Passive  perception  system  algorithms;  stereo 
correlator,  rectification  and  pyramid 
algorithms 


ANS 


RDECOM 


Gish  III 

22  Lift* 


GenlUa 
l2fl  Line 


GenIVh 
129  Uvtt 


c>l  ■*'.* 
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RCTA  Transitions  to  TARDEC  VTI  _____ 
Advanced  Development  Programs  ^ 


•  Hardware  and  software 
perception  sensors 

•  Sensor  processing  algorithms, 
including  pedestrian  detection 
algorithms 

•  Vehicle  planners 

•  Planning  algorithms  via  Terrain 
Reasoner 

•  Selected  tactical  and 
cooperative  behavior  algorithms 

•  Perception  technologies  from 
the  3500-pound  XUV  testbed  to 
the  18-ton  Stryker  vehicle 

•  SMI  related  components 
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irmtI 


RCTA  Transitions  to 


•  Perception  Sensors 
(LADAR  and  EO/IR) 

•  Sensor  processing 
algorithms 

•  Vehicle  planners  and  OA 
Planning  algorithms 

•  LADAR  optics  and  TX/RX 
electronics 

•  LADAR  processing 
firmware  (FFT,  multi-pulse, 
ranging,  etc.) 

•  Acadia  Vision  Processor 


PM-FPS  MDARS  rdecom^ 
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m  RCTA  Transitions  to  AA  TD  UA  CO 


•  UGV  Perception  Sensors  and 
Demonstration  Platforms 

•  UGV  and  LADAR  Sensor 
Processing  Algorithms 

•  Vehicle  planners  and  OA 
planning  algorithms 

•  Market-Based  Collaborative 
Tasking  Algorithms 

•  SMI  Interface,  Decision  Support 
System,  and  Terrain  Reasoner 

•  Air  /  Ground  Cooperative  C2 

•  Test  and  Demo  Facilities 
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i  0  RCTA  Transitions  to  MDARS 


Entered  Low  Rate  Initial 

Production  in  December  2007 

•  Perception  Sensors  (LADAR 
and  EO/IR) 

•  Sensor  processing  algorithms 

•  Vehicle  planners  and  OA 
planning  algorithms 

•  LADAR  optics  and  TX/RX 
electronics 

•  LADAR  processing  firmware 
(FFT,  multi-pulse,  ranging,  etc.) 

•  Acadia  Vision  Processor 
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i  <9  Robotics  CTA 


Geometric  planning 


Planning  with  adversaries  Bfest  info 

planning 


Control  for  difficult  terrain 


Mid^nge  perceptio 


Planning  for 

dynamic 

environments 


Providing  key  technology  for  future 
Army  unmanned  systems 
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Personnel  detection 


Multi-modal  interfaces 


Long-range  terrain 


LADAR 


Collaborating  robots 

I — 

S m 

h  pp  fi  i*i 

E  mm  <h  ■  « 


Scalable  interfaces 


Terrain  classification 


